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! - ■ • ABSTRACT • .'^ ' C 



/ 



A' quality assessment methodology for am'bulafpry patient cafe is under 



development by the, Office of Research and Devel'opmelnt of the Indian Health 
Service (IHS) . This report suimnarizes the ^conceptual basis of ^he methodology 

• / ' ' ' . ' 

and describes a pilot test in six IHS Service units* The results for seven, 

* ' * • * 

trace? conditions, designed to examine system performance 3ya terms of isare ' 

provided by tlje system,^ care received- by the^ beneficiary populations, and the 

♦ 

continuity ^pf-dare are presented."^ .Although the data from six- service unit$, 
chosbn^in a non-random manner, do ^ot necessarily reflect the quality of 
/|,- 'ambxilatory care throughout the IHS, seyeral trends are noted and t)riefly dis- 



INTRODUCTION: - ^' 

Although there isva growing coneeni with the quality of health care, 
'most of the developmental effort to date has concfentrated on inpatient ca?j. 
Currently there are two. major organizat^ions of national scope concerned witn 
controlling the quality* of inpatient care. The Joiijt ComMssion on Accredit- 
ation of Hospitals (JtAH) ^egan certifying hospitals on the basis of structural 



criteria-in-i952i— and-more ^ecent-ly-has-been-exapiining hospital care ,through 
the use of process criteria. The .I^SRO legislation of 1972 (P,L. 92-603) ' • 



directed that medical care evalijations were tp^e pre -requisites for reimburse- 
ment of costs p^yal)le imder Medicare and Medicaid. In comparison, methods f or ^ 
examining the quality of ambulator^ health care, havp remained in their infancy. 
The Indian Health Service (IHS)^of the Department of' Health, Education, . 
and Welfa?*^ has the primary responsibility for assuring comprehensive health 
services to* Aiherican Indians and Alaskan Natives. This re^onsibility is 
discharged through a series of service uiiits locfated in Indian communities '^d 
' desighed tq provide preventive, health maintenance, and curative services to \ 
the beneficiary populations. The typical service unit includes a 25-50 bed 
* community hospital and outpatient clinic, one of. more field ^clinics, and re- 
ferraci capability to a major medical center. A field health service*^ consists 
of public health niirses, sanitary engineJer$, and ohe or more tribal ly operiited 
health programs dealing with issues of prevention .and community health 
education. * • ' . ' l 

The Indian Health Servicp is de^ly concerned with ^he quality of hospital 
care as witnessed by the relatively larg'e number of service unit- hospitals 
'wl^ch have earn.ed JCAH accreditntion. j However, hospitals are a component or 



the IIJS system, as»opposed Jt6 the IHS acting, as a system of hospitals. For . 

this reason, concern for the quality of. care. in the IHS extfehds td the care 

■« • ' ' • ' . 

, :provided in the outpatient clinics and in a variety of field-based activities. 

O^.particular interest is the continuity of cjare between these various com- 

ponents of the^IHS system. * \ ^ * 

The. Office of Research and. Development of ^he Indian Health Selrvice has ^ 

• been developing a methodology for asses'sing the quality of ambulatory care, 
which has been* previously described C*>*2,3>^ i^^g report is part of a series 
describirif a pilot test of th^ assessment methodology iri six' service units of 
the Jndian Health Service, three rural private practices, and* two large health 
maintenance organizations. This report presents and discusses data on systems 

* perfprtn^mce drawnr^rom 't|^ sijc IHS setvice units* Subsequent reports will 
'examine other aspects of the pilot studie^s. . . 



METHODOLOGY; 



The conceptual b^s;Ls of the assessment me'thodolbgy'has been fully described 
eiseWheue ^2,3)^ -^^ Nummary, the assessment strategy is completed in stages. 
First, a set qf health \pfoblems (trac^ers^ is selected to -represent the major 
health problems,of the Community. A- process"" map (or, clinical algorithm) .is 
constructed for each health problem to^ describe the expected process of. health 
care.' Process maps specify necessary elements of prevention; -screening,.- ' 
•diagnosis, treatkent, and\ follow-up, ahd they define , acceptable .^jsalth outcomes. 
In genera V the set of tracers* sheeted sHbuld, 'as a -group, ineiiude all>the 
clinical functi-ons of health care for examination. *' ' 

Criteria of clinical cSare are defined foi; each tracer condition and are 
translated into > audit questions (called indicators) s^hich are the actual 
measures 'of, quality. The iadicators are generally of.'fhree typ^?. Population- 
based .process indicators express a percent of the -t'ota;L conmunity which h^s 
received a paxticulai!; health. 'service. This class of indicators characterizes 
^ the extent to which the health care system is -meeting the needs of its total 
patient population. By tracking specific patient cohorts they describe the 
continuity, 'distribution, and appropriateness of health services received. 
This meaisure pf system performance iuight be reflected by population-based > • 
indicators such as; . ^ 

1. 'What percent -of the- community has been adequately screened for 
hypertension? ; # . ' L 

What percent of infaiU:s in the' community ha^e been 'adequately - 
immunized against poliomyelitis? 
^ 3. What percent of patients diagnosed with otitis media, received - 
^ ' adequate antibiotic thefajJy?' * ' , , \ ' 



Providers-based indigators exjuress a ^)erc;ent of contacts .between patients^ 
and the health care system in which particular health services were provide4. _ 
This clas3 of indicator characterizes the adequacy of health services provided 
When patients utilize 'the' health care system* * Provider-based indicator datia 

can be aggregated to characterize the performanx:e of individual providers, I 

* ^ ' . * " ^ . . / • 

provider disciplines, or aU providers' £n t^ie system^ This performance measure 

might be reflected by indicators such as: * , . ' 

.What percent of patient visits due for screening ^blood 

pre.ssure resulted in a blood pressure recording? 



2. What percent of infant visits due for poliomyelitis immunization- 



resulted in an immunization? 

» , . ' , 

Xs. ' What percent; of patient visits including a diagnosis of otJ'itis 
media, was appropriate antibiotip prescribed and a follpw-up 
visit scheduled at an appropriate interval? — - , 
Finally, health status indicators e:cpxess the percent of patients for 
whom a change in health status has been documented. One should be cautioned 
against equating health status indicators with measures of incidence or pre- 
•valence: since the latter requires a random sampling of the population. Health 
status indicators on the'other hand often, reflect change in health status of 
^elect6d patient group; e.g., only those.who were £ollowed-up. 

Table 1 shows the tracer conditions used in the. pilot study along with • 
the assessment perspective (population-based or provider-based) and clinical , 
functions of care covered. by each.' Figure 1, shows the process map for 
lacerations and the points in the process of care from which indicaj;or data 
is extracted. * ' - ' ' • ' 



Some indicators are ana^^'gous to "Blow meters" and- can be 'Constructed in 
'a sequence iiT order, to examine the continuity of care^ From the process map 
foy.iron deficiency anemia, shown in figure 27~"the population can, be seen to * ^ 
percolate down through a. variety of pathways,' If flow meter indicators are 

placed along the major rdut6s, they will "^measure the di^riljution 'and continuity 

' * * ~^ • * 

of health services. For example, if an indicator is placed at the entraiilce^o^ 

\^ f \ ^ \ ' 

the diagnostic element, the results will show how well diagnostic servicesi are'* 

- . ' ' ' - ^- < • * • 

distributed among the screened-pos itive p opulation.. These indicator sequences 

L_ „ ' . ' . ~~ \ 

may focus on ahj^f the clinical functions ^ of the health cgtre process and can 
expresl "continuity" as a iseries of conditional, probabilities based on 
empirical data. By e:5amining cpntinuity of care in this \iay, the assessment 
methodplogy can identify discontinuities in health care and distinguish V 
between those related to provid^-befhavior and those related to patient 

A , ' '\ ' * ' ' ' ' 

utilization of services. < ' * ' : 

. In g^nferai a "r,equired health task is completed only when three basic steps 

occtrr. First, theri5 must be contact between tlie patient and an '''appropriate m 

provider. Second, the need for that health care task must be reco^ized, and^ * 

-^fjjially the task must be pe.rfoimipd. Conventional wisdbm would suggest that *• « 

\ * . "'^\^» * ' = ^ 

making contact with the health caye .system <For services is generally the re- 

sponsibility of the patient^. The recognition function 'is the shared re- 

sporisibility# of the patient, who may.^ reflect need in his chief complaint, and' 

the provideiJ whdT'reviews the patient's Record." The performance- of the task, 

finally/ is the responsibility; of the- provider. In this study urinary tract 

infections, iron-deficiency anemia, and hyperteiision are the tracers designed . 

to examine the continuity of care in this way. > 



• The seriocfe mits enspi'oyed as pilot sites in this study were chosen in -a 
• ♦ . • ^ " . . '. 

non-random manner. . "Four df the six were included because of a shared concern 

for-.the quality of ambulatory care/ while the other two 'were included due to • 

' cWacteristics of .their system or population that made the total group more 

representative of IH^ service units in general, Table^? compares the service - 

:i I 

units by major characteristics. 'Criteria of clinical, care were estgiblished 
for each tracer by a consultant With recognized expertise in tlhat conditio^/ ^ 

V * f 

^ The* criteria were reviewed and 'approved by^the clinicaf staff of service' units 
C and which were the original pilot sites. /The*^criteria wefe presented to* * 
%he clinical staff of each'of ^the other service units before or. during the 

•study and there Wfere no par^*euj.ar objections 'to the criteria establj,3hed. 
/ Within each tracer condition, indicators were selected to include.' criteria 

I • • . • • * • . V. ■ - 

tna^ were considered essential to good basic health care. Itdms that w^re 

cohtrove^^sial or would be applicable in only a small percentage of. cases were 

* » _ 

not used in formulating, the ♦indicators. i\lso tasks which- were felt to te • 
reliablyn documented (or at least should be reliably documented) were mofe afjfeen 
incorporated intb the indicators, items which- might bexf)erfon»^d regularly, 
;but infrequently documented', such as elements of 0i historj^.'br physical 6xam^ ^ 
or counseling tasks, were incoporated into indicators only /when they were can- ^ 
sidered to be ^essent;ial for basic health care. The indicattors are shown in* ^ 

tables 3 to 13. . * . . . ' ' 

•f 

• ✓ 

Data-^collection instruments were designed for extracting the data required 
to compiite each indicator ai^ were ^bsequently' field-tested. These 'were 
described.and illustrated previously. 

Previous exflprience with this methodology has suggested tdiat a number of 

\ ■ • * • ^ 
individual's can perform wpll in dat* collection. In this pilot stu^y data 



collectt>rs included undergraduate students in health administration, a medical 
.student, a physician, and a laboratory technician with'an-MPH. A study of 
reliability,. using the physician as a standard, was dohi on a sample of cases 
reviewed by each data collector. None^of the data collectors varied by mo;:e \ 

thah 10% compared to the physicim^ ^ . ' 

• ' ' ' 

Patient ^horts were, selecte^ for audit for each tracer by ^anJpling from* 
•the entire catchment area as nearly as possible. This was done in an attempt 
to remove a bias toward patients Who were mye frequent utilizers of health 
care. To examine the quality'of prenatal care for example a list was compiled 
o^ all women pregnant during the study year by. examining birth certificates, 
thfe delivery r«om. log, discharge diagnoses, operative reports, an^ lab ■'•m^' s 
requisitions for "prenatal lab work." From this list a sample was chosen using 
Standard sampling techniques. Similar techniques were used to gather a ,^ 
sample of infants for examination "oT infant care, and of adults for audit of. 
hypertension screening. Cohorts for urinary, tract infectiqn and .anemia were 
selected from laboratory slips or the laboratory log as these tracers examined 
the continuity of c'care .distal to the screening process. Any patient .found 
on audit to have.un'deAying ren^l disease or a n6n-nutritional cause of anemia 
were discar^d from" the sample. Patieiit cohorts for streptococcal pharyngitis 
Were^ener^ed by randomly pulling medical records .and searching for a visits 
involving a sore thrpat. ' Finally, the patient cohorts for lacerations were 
identified by review^ of^he* emergency room log. ^ 

Audit: or the cai'e 'for - each patient involved" examination of each health 
record-extant'lfor that patient. In many- cases this required audit of a medical 
record at the hospital,* one or more .field clinic records ''and public health 



nursin;^ records, in order to extract a complete profile of care for each^pafient 
.for that trater condition, ^ ♦ * * 

RESULTS AND DISCUSSION: .... 
' . At the outset it should be emphasized that the central purpose of th^ 
quality assessment methodology is not to make statements of "good" or "bdd" * 
care. Rather it Xs designed to identify the relative weaknesses in the system 
of health care that require attempts at improvement. , A' part of this pilot, 
study examined the quality of ambulatory health care in rural private practice ^ 
and health maintenance organizations, The^e results suggest that the IHS in 
general provides care. of comparable quality and will be the subject of a sub- 
sequent report C^) . ^ 

The results ^pf' the study in the six pilot s^ifes are shown in tables 3 1:6 
13* The results are shown for eadh service unit and. the arithmetic total for 
^11 service units combined^ AJrthough statistical tests of ^significance have 
not been systematically applied to each service unit', Spot .checking reveals 
that for selected indicators there is significant variance between setvice 
units. Because of* this .Variance and the' non-ran^om method vof selecting these 
service ,iinit$ for the pilot study, the results should be generalized to other^ 
service units of the IHS with caution. Ho\<(pver, some ^ trends can be noted and 
• tend to be consistent across the six 'pilot sites studied. 

WELL-PATIENT CARE : 

Examination of the results for. prenatal and infant care (tables 3'iand 6) " 



efa] 



^ 



reveal generally low rates for counseling and educational* tasks (e.gi 
nutritional counseling, infant care counseling), Of tMs category, "fa^a;ly 



planning counseling" Ctable 3) appears to. be the most universjally applied at • 
53%' of the prfegnant population. It is interesting to note that service Unit ; 
A with a predominantly suburban population is aiAstantially higher 4han the 
total for this cla^s of ^indicators. ' • * , 

. Similarly^ care tasks related to health. statusjmonltAring. are al^^^^ 



what' low. From a. population perspective the "pregnancy «»mbnitoring rate" (table 
33 was only 16%. Yet' from the p:i^vider perspective (table 4) 'this fate vas . 
79%. This is to say that the providers perform the tasks on, 79% of the 
opportimities, yet only 16% of .the pregnant ,population receives the tasks at 
appropriate intepals. On the other hand the diet 'monitoring rate for infants 
from the population perspective ' (table ,6)* is 7%, while from the provider . per- 
spective ttalile 7) it^is only- 38%. Jhis would suggest that the' system is * ' . 
missing a substantial number of opportunities to monitor the diet of infants. 
Similar reisults are noted for the "intant 'care counseling';." "growth monitoring, 
"developinent monitoring," and "nutritional, counseling" rsites for infants 
(tables' 6 and jy anH.for the prenatal "nutritional 90unseling" rate (table 3). 
. In this study, the^'data collection procedure' was extremely lenient in inter- 
pfeting th^v content j?f /the record regarding e4iicational and counsj^ling t^asks. 
For example,, single jgtateineirts such as "walking" or "rolling over" or c 
"development WNL" were cpnsikered adequate for/ the "development monitoring 

rajte" (table 6) . " 

» ' « * * 

Nonethelessi iti could be argued effectively that the perjSormance of 
monitoring^' educational; and counseling fasks is substantially better than the 
documentation of performance^ While this may be very true, the iiiq)ortance of 
documentation of tasks critical to adequate care cannot be over-emphasized. 



particularly in ^ setting in which multiple ?i-oviders participate in the care 'of 
patients. Without adecjua^te 'documentation; the assessment o^^serVic^ needs ffer 
any given pakeift visit rests on the p^der's,a§simption' 'rather than knowledge- 
of wlucli tasks'have l?een done and which are due. • * . . 

- The, "prenatal work-up" rates (tables 3 and 4^ indicate that onl 3^26% of^he 
pregnant w6men in the community receive a prenatal work-up by tl^e^Oth-^ 



gestational week, while the. providers perform the work -up within two weeks of 
th^ initial visit on 34% of the patients. Apparentl:?- provider" pef^rmanoe is\ 
the limiting factor since 64% of a^ pregnant women in the ^community make 
contact withithe system by -the •20th/ week of gestation. The prenatal work-up ' 
rate is a compound indicator requiring four separate tasfc, of which the 
cervical cul|«re was by far the moi't frequently, omitted. ' ' « 

^ , A contriisting pattern is seen in the pregnancy-induced hypertension (PIH) 
screening rates (tables 3 and 4) . In this case' only 25% of .the prfegnant' 

if ~ 4> ■ " • - • ; ■ 

population was adequately screened. However, the providers .recorded diastolic 
^i?^?* P^®^^®^ of all visits by prenatal patients." For this indteator- 

it appears that patient behavior (prenatal visit patterns)- is the limiting - 
^Sor. Hov^vdr, in Jhis regard it should be noted that the "abSrmal BP 



r^ifipgniticn ;^at-es" ("tables 3 and 4) were only 36% from both population and 
p^pjrider perspectives- This suggests that although the system was' effect^vely 
capitali2ing*oft^the dpportimity to document blood pressure, diastolic pressures 
greater thanvSQ. mm. ttg. w^re recognized only 36% of the time. ' ' ' 

, The immunization rates of tables 6 and 7 deserve comment; Of the total* . 
infant grou£, 69% had recei/ved TDPT and 2 OPV immunizations by age"^ 13 months, 
with a hig^i of 90% in service -unit E. The "total immunization rate" of 40% 

... . . I 

In. 14 • ^ 



-added measles and rubella to the criteria. .It should be noted that the audit ^ 
"period of this study preceeded the current immunization recommendations. by the 

American Acadejiy of Pediatrics, US Public Health Service that measles 'be . 
•deferred until 15 months .of age.- ' Although it is difficult to compare rates 

across, differing critei^ia, these results appear to compare favorably with 



immunization rates previously described among the" patients of pediatricians 

The health" status indicators for prenatal care (table 5) and infant care 
(table 8) are not particularly. enlightening due to the relatively 'low frequency - 
of poor outcomes 'in these two groups. '.However, the "adequate growth" rate- for ' 
infants (table '8) reflects an expected result despite the. previously .nc^ed low 
rate of growtH monitoring, diet monitoring, and nutritional counseling. 
Finally, the "repefaf' pregnancy rate"" is encouraging as only 15% of pregnant, 
patients in* the study period failed to space their subsequent -delivery by at 
least 18 month^ ^ * ^ * . , • ' \ 

ACUTE CARE : " , \ 

Examination of results for streptococcal' pharyngitis (table 9) and 
lacerations (table loj provides information on the manner in which the -health 
care system is dealing with an acute infectious process and a minor surgical 
problan. In reality these, indicatpaps should be termed patient -based rather 

than truly population-based since the cohorts were by necessity selected from 

J ' 

the subset of the populatibn, who initiated contact with the health care system. 
The re.latively high "selective screening" Tate for streptococcal pharyngitis 
reflects the concern of the IHS for streptocpccal disease and ensuing rheumatic 
fever which still exceeds national norms in son* Indian and Alaskan Native, 
communities. The "treatment rate" is also extremely high, although the "treat- 



/ 



ment of choice" rate is somewhat lover due to use of a second line antibiotic 
(presumably .amp icillin) in service* units B and E» The "unsupported treatment'^* 
rate is acceptalky low although peaks at 37% in service unit 

The documentation of **wouaid description" and "extent of injury" for 
lacerations (table 10) is somewhat low. ' However, it should be realized that 
both are compound indicators, i.e. requiring documentation of several items- 
♦each. In general,' 64% of patients with a sutured laceration retimied in an 
interval of'time appropriate for follow-up and 56% satisfied follow-up * * 

criteria. However, in service unit F, 42% returned for follow-up^ whereas \ 

1 ^ ^ ' ' ' 

follow-up criteria were .met in only 26% ' ' ' , 

CONTINUITY OF CARE : 

The indicators fdr iron-deficiency anemia, (table 11), urinsuy tract 'in- 
factions (table 12), and hypertension (table ,13) were constructed to assess the 
continuity of health c^e. Each expresses, thp probability (based on empirical 
data) ^mt patiL^pnts successful in the preceeding^lement of care, will pass 
successrally through the next pyocess element. Likewise the^ transition rates 
through multiple successive elements of the process of care can be\ expressed 
as the pgroduct of the intervening rates. Perhaps the- most-publicized sequence 

' • ^ ' i * * 

of transition rates is the "% %" series- used to descril)e -the -care of ^ 

hypertejnsive patients. According to a public health advertizing campaign^ only 

oneT^half of the hypertensive* patients ha^been diagnosed, and of these, only 

one-half are under treatment. th# product of these (0.5 x 0.5 = 0.25) expresses 

the probability that a given hypertensive individual has been, diagnosed and 

« 

placed on medical management. 

• This -approach has* been applied to the aggregate service unit da|ta for 



{ 



^ i 

'Tlrinary irjict infect ions ,CUTI) iron-ideficiency anemia as shown in table * 
14. The "overall prpce^s success rate" is derived from the product Vjf the 



succe^ive indicators, -^d is for 'UTLand 6/5% forWemia.. The same 



approach alsq^can be used to .examine selected Sequences .6f care't For example 
th^ pro'bability that a screened ^pQsitjve individual vill progress through the 
process as far as treatment, is CO. 88 a 0*89 x.O.SOTx 0.95 0.37) for UTI and 

(0.87 X 0.^9 X 0-49. X' 0-82 = 0.24) for anemia. ' ' ' 

♦ / ' " • . ' . ' 

Similarly it' is possible to estimate the impact of improving selected 
a^ects^ of caire by^substituting iii the cross -product equation. For example 
the benefit derived from increasing the recognitio'n functj.ons to- an ideal ' ' 
level ca:;^ be estimated by substituting 1.0 for the observed rates of recogniti'On 
steps. Since improvement of this magnitude may be /somewhat untealistie, 
an estimate can be'^made of the impact of increasing the recognition rates to a 

\ ^ : ' • I 

level midway between the observed and ideal rates. This^can be dontf by ' 

I 

Substituting • * * . i 



Observeii rate + (1.0 - observed! rate) 



2 



for the^recognition" indicators. 



/ 



As an example, table 14 compares the observed /*^overail"|)rocess success" 
rates fox UTI and anemia with those derived from Estimates of raising selected . • 

functioms to the 90%. level. Improving* "recognition" and patient "contact" * . 

• • * * 'I ' * 

rates to 90% has roughl)r the same impact, Although in mdst health care settings, 
improving recognition rates (provider behavior) would be more easily accompliish- 
ed than improving patient contact rate (patient .behaviot) . Improving assessment ^ 
and treatoent tasks to 90% achieves yet more impact ior UTI, and improving 
combined recognition-action tasks results in ^bstantial improvement in ^^overall 

4 • ' * ^ 



t 

1 



, process success" for both conditions! As an extension olf this' approach^ the 

• * / • * 

, estimated increase in clinic workload (physician visjts, laboratory sjsrvices,' 

pharmacy services, etc*) accruing frim '^ch improvements can also be 

estimated. 



However, each Service Unit presents a unique configuration of health ' 



— serva^fces -and- service-strategies ,"and-^ome^service-xinits-do-not-necessaril-y^-. 

. 'follow the patterns that eper^e from the aggregated data. Table 16 presents 

the observed rates for anemia along with the estimates derived from projecting,* 
^ * » , ' 

improvements ia contact, recognil.ion, and tasi: performance, for service units 

A, 'B, tod F. Service unitjA derives its^greatest protential improvement in the 

Continuity; of care^ from- itlcreasing* the recognitipn rate^^^hich results in an 

overal't process success, change from 11% (observed) to 20%\ Service unit B, on 

the other hand, derives substantial improvonent through improvements in patient , 

- contacts rates, thus inwe^sing the overall process success rate- from 3.3% to 

13%. FinaltyV service unit F realizes a projected nine-fold ^improvement in ^ 

continuity through improving the rates of taslc pe^rformance, .thus increasing its 

observed rate of 0.8% to 7,7%. 

Further" variation in the ,cpntinUity of. care among the service units is 

isummarized in table 16. The ''case finding rstte" is computed as thej^oduct of • 

all ^rates' from "contact for screening" through "diagnostjLc y/ork-up". The 

^ ■ ' • ' > ^ I . 

^/"Vfollow-up rate" is similarly computed as the product of the /^contact for follow 

up rate," the '^follow-up recognition rates," and the "follow-up /rate." Also. 

shown in table •16, dire aggregate rates for patient contact, recognition, and 

task peTformance. The '.'aggregate contact rate" expresses the probability that„ 

* • ■ '\ . } ■ ■ ' .'i 

patients will make all required contacts wit^ the system for anemia, and is 
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computed 'from tl^e product of the tliree contact indicators. Similarly the 

\ 1 

"aggregate recognition rate" and^ "aggregate task performance rate" express the 
probability that all required^recognytion st^ps and all tasks are performed, 



^ 



respectively, and are computed frbm t^6^ su?n of the component indicators. 

From table 1^, it cka be seenHh^ \s^ice unit A clearly is superior Hn 
H:as€f-findijig-wh^ile-^ervlx:e^unit-I>^^ "aggregate;— 
contact, recognition, arid task performanceyates of^table W, it is app^rekt 
that service tmit A has no relative weaknejssW^hile service unit B is 
relatively weak in patient contact and the relative ^impediment to coritir 

in service unit C is recognition. Both service unit E and F perfoim relat-$vel/ 

. . ' \ • ' > 1? ^ 

well* in patient contact and recognition, but fail t (3 complete the reqiared * 



uity 



health service tasks. 
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CONCLUSIONS: ' ■ 

• ^ V^lot test of a quality assessment methodology iiTliS 

service raits have been described. The limited data suggest that although 

'.each service -unit presents a different profile of health care, some general 

. .^rendsf' can be'de^j|ted.. Relatively low rates. for counseling and educational ' 
tasks in maternal ahd- child. health have been noted; How ever, whether these 
rates reflect system performance or documentation practices are un4qiown. 

',Iri sev^al cases the ^limiting dEactor in the .pi-ovision of a health service was 
noted to be a lack of recognition of service need by the provider rather than 

• the conventional assumption th^t patients do not utilize services '(make visit*) 
effectively. Finally, examination of the coVitini^ity of care suggests that 
substantial improvemerft can be achievfed by pinpointing .and addressing a^eais of 
relative weakness^ A subseqvtent report will -show that similaf problems* 
exist; in the. rural pi:ivate practices and health maintenance organizations 
cooperating in this pilot study. -V^ . ' 

pie., study suggests four i|ajor methodological issues that should be"of 

.concern in futiire application of quality assessment techniques to " ambulator/^ 
care.'- First, examination 6f provider performance alone does not rtece&sarily •* 
reflect ^he adequacy;' of' care received by the patient population. In this 

• ♦ • 

stud5£,population-based and .provider -based indicators were' employe^ to examine 
the effectiveness of care received.' * 

^ • Second, the study employed'.indicators specifically designed to examine 
the continuity of care. These results suggest significant -impediments to the 
continuity of health care that would n6t have emerged from a study^ that emphasiz 
ed only the adequacy of the diagnostic and treatment processes alone. This 
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study would suggest that improving the adequacy of only the diagnostic and 
treatment aspects of^care to an ideal level would not necessarily result in^ 

. .continuous care for the majority of- patients. ' * 

Third, examination pf health status indicators, do not add significantly 

' to the information /derived from this methodology.^ However, important o^tcome 
measures jpay te to assessing the quality of health care, additional 'develop- 



mental work is needed to clarify a concept of healt:^ outcome' and 'apply it to 

quality assessment techniques for ambulatory care,- \ 

Finally, this study methodology is based on the tracer approach to 

appraising health care. As-such makes' two assumptions which* have never 

■ \ • ■ j • 

been adequately tested. First it assumes that the informatiifc derived from 

examination of a "tracer" disease is similar to that which would have been 

obtained from examination of , other "similar'! conditions ^ More importantly,. 

the ^implicit assumption Within a tracer approach is , that 'adaptive processV^-^ 

directed at improving identified deficiencies in health care foV a tracer, * 

wi;i result also in improvements, in other "simiJ^r** conditions/ 'The latter 

assumption is particularly tenuous as attention directed toward .a ti^acer 

condition may, in reality, detract from the care provided for other similar 

conditions. Several studies are currently underway at the Office of Research 

• , " * , , ^ ^ . Z^' 

'^d DevelojJraent, IHiS to test these a;ssumptions, ^but until objective evidence 

is available such atssimiptions must be viewed as tentative^ 



/ 
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FIGURE 1: Process. Map. For Laurations, Showing The Points In The Process ' 
* ; Of Care From .Whicfi Indicator l5ata Is Extracted. , ' ' 




.Is. ;'; 



, . FIGURE 2: Process M^p For< Iron-Def ictency Anemia. Indicators Placed Sequentially Along The 

O L Process Can Express^ "Continuity" As A Series Of Conditional Probabilities based. 
\ £RJC J Empirical Data. In This Way, The Relative Impediments to Continuity' Can Be, \ 

\\^m^^m }\ ^'-Pinpointed." ... r> ^ '-'^^ - ' 
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TABLE 1 :' Tracer' Conditions Used In Pilot Study In Relation 
.To Th^ Assessment Perspective And The-Qlihical 1 
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TABI£ 7 i ^rovid«r Ptrforunctt 
for Infant Ckc% (provid«r**bM«d 
procflfg indicatorg) 




' TABIB d I Infant Car* Outooats 
(Itoalth Status Indicator*) 



(Health SUtus Indicators) ' 
ETOCMOR DESCRIWKXi 


_Un1 


vica 

t a 


ian 

Unl 


tic* 

:_5 

"m , 


Sarvioa 

Unit C 


Service 
Unit 0 . 


Sarvica 

unit B 


Sarvica 

unit r 


total 






% 


n 


% 


N 


% 




% 


N ' 


% 




Aclequata 

Gia/th 

Hate 


4 

Perosnt of infants who wore between the lOth 
and 90tii percentiles for height and 
i^ight at approximately one year of age. 




33 


74 


27 


^ 

73 


76 


69 
















Bicth 

I&pression 

Rata 


Percent of infant^ wl^o hfd an i^ar of 6 oir 
less at one minute or jh^s tHan 6 a^JSive 
minutes.-'^ 




SO 


4 


49 ' 


/' 


7& 


6 


41 


3 


2? 


3 


^0 


3 


Z17 ' 



39 



40 





JeiU 

% 


.. H 




t B 


% 


ACM " 


^7 


Hi- 


* San 




oo 

— Un 


U r 




selective 
Scfscning 
Bato * .... 


ycroent ot pAtient-opi socics o( phaxyivjitxil 
who xcoeived a throat cultucc vd|iiln tuo 
days of the initial visll;. 




^1 








N 

/37 


% 

Bo 


so 




...M ... 

534^ 


iticdtmcnt: 
Fata ^ 


t^^roBnt oi^ patients with a positiva strep 
culture who rooeivcd an tfitibiotio witliin 
fiva ddys of tho calturo date*. , 


loo 


<• 






77 


33 


83 


■44 




IL 


ioo 


Z 






Of-dioico 
Bate 


Percent ot j)atient3 with a positive strep 
culture who iciceivaJ either 1.2 m lA bicillin 
(600,000 units for diildten less than>60 lbs. . * 
or 0 years of age) , or^l pdhicillin for 10 days, 
or erythroiycin for 10 d^s within 5 days of 
the culture date. 


U 




* 

SB 


/2 




33 


83 










z 




l/Z 


Unsupported 

Ttcataent 

Bate 


Percent of patients with an episode of pharyngitis 
v/ho received an antibiotic without receiving a 
throat culture.. , 


c 






So 












52 








S34^ 


Stjnep 

Culturi^ 

Rata 


Peroent lor phatyngius episodss cultured whidi 
resulted in a positive culture for strep. 




4/ 

>, 




3? 


33 


9? 


3^ 


//3 


3^ 




s 


42 


1 

^1 





TABIX^^ I Syst«ii P«rfora«ncft 

rpr Streptococcal' DlMasa (popjolation 
, bas«d pro€«M lAdlcators) 




1^ 



jimcmK 




. b«cvt.e« " 
Unit A 


Unit a 


barvica ' 

Unit C . 


"• Marvica ' 

• Unit 0 


Unit K 


Unit r 




% 


H 


% 


N 


% 


H 




N 




H 


' «. 








Doscriptton 
Rate' 


Percant of ccalp or extremity Iflo&ratiais for 
vhidi tha follcuing were dodum^teds 

1« tJjna sinoo ti)o laooration 

2« cause of the laceration 

3. description of laosration 




50 


B9 


\ 

if 




/ ' 


23 






\ 




so 




5f4 • 


Docu^dntiitiat 
Of Extent of 
Iniuxy Rato 


Percent of scalp or extremity lacerations with 
docur;cntation of ^eissinont of boiie, nsrve^ 
andt/or vascular involvement. 




5b 


22 






/ 

too 


/& 


95- 


r- 


So 


2d 


so 




m 


Tetanus 

Prpphyltt^s 

Cbvarago 


Percent of scalp or extreinity lacerations.- 
whidi had docuicntation ^f current tetanus 
covorage, or were provided additional 
coverage. 


is 


SO 


90 






ioo 


3/ 


9S- 


^1 — 


SO 


68 


So 




394. 


Kavisit 
Kate 


Percent ot patients tvho had luo^ration sutured 
wiio hed on encounter with any provid<^ for any 
reason within 5 to 15 d£r^s after laceration 
was sutured* 


ec 






30 


U 


7Z 




23 


41 


^4 


42 


43 




Z23 


Rate 


Percent of patients with sutured laceration for 
vlicm soQie statcoient of wound healing was made 
within 5 to IS days of initial encounter for 
the laceration. «^ 






8o 


3o 


SB 


7Z 


74 


23 


SB 


34 


2t 


43 






CX>3orvoci 

Infection 
Rito 


Percent of scalp or extremity lacerations with 
docun^tation of a wound infection, (2 , 


i 


















SCk. 


8 


SO 


6 


1 


» 


TABUS to t 8yat«a P«rforaanc« 
For tacerati-ons <popul«tion-^As«d 
proo^as indicators) 


















' a. 




V 


V 


» 






/ 










ff 


A 






'- 

* 




i 

1 ' 

1 - 






\ 




Contact 
ftor 

Screcining 
Bata' 



Screening 
Rata 



Evaluation 

GontAct 

Bato 



Xbnopnal 

Bsbognition 
Rate 



Diagnostic 
Work-up 

jRate . 

Rata 



Contact 
Rata For 
Follon-up 

I^oognitloa ' 
Rate 



Raid 



DCSCiaPTIOl 



Percent of infanta and prcnataKpaticnta 
w1k> isade contcict with the hcalthS^ira 
^steai vtoi thc^ roq[uitcd screening for 
anemia. (Percent of infants contact' 
tho systeiii beb^'ecn ago 6^*13 months* H 
cent of prenatal phtients contacting 
system by 20th x^eck of gestationj / 
Percent of infanta and prenatals maJdng 
bontact for screening, had a hcnato* 
. crit and/or h£»noglobirt> 
Percent. of patients screened positive' 
for anemia (Hct 33* anchor I(gb 11) \Ayo 
made contact with^the system within 3. 
, wee);s after positive screening* 
Percent of patients making contact fSF 
i/icn there is any statement or action 
indicating reoognitioa of the abnozmal 

result, 

Percent of patients with recognition 
of abnormal result, for whan .any stato** 
mint of dietar^^ intake was nado. 



itar^^ ' - ^^ 

Perp2i)t Of patients i^lth rcoogniticn 
of abnomsal result, w!io \^era started 
on iron tlierapy. (1 v^) 



rapy> ( 

Pero3nt of patients who made contact" 
with tl^o health cajc^ system witldii 
3-6 weeks after iron therapy v/as institouted 
Peroant of patients contacting tlV3 systan 
3-6 weeks after .therapy started, for whom 
there was any statemant or action indicat-* 

ing the need for folto^nip, - 

teroont ot patients with recognition of » ~ 
tho need for follavH^ who xeceived^a heno* 
glcbin^ancl/or hematocrit within 3-*6 weeks' 
after institution of iron therapy. 



setvic^ 
Unit A 



9^ 



77 



!9 



7B 



69 



S7 



/DO 



/CO 



4S 



40 



3Z 



3Z 



2& 



'S«rvic« 
Unit B 



7Z 



7Z 



St- 



7/ 



SIS* 



4S 



8o 



/oo 



'9/ 



72 



so 



ZB 



2D 



II 



Unit C 



C9 



/fiO 



3^ 



8B 



3'i 



ZO 



/s4 



MO 



3^ 



?<5 



^7 



Unit D 



1& 



62- 



/oo 



IB 



/oo 



75 



7^ 



77 



II 



a 



Servlc. 

Unit E 



7/ 



34 



3.B 



65- 



ii 



so 



58 



4/ 



So 



7^ 

4B 



4& 



27 



23 



lO 



Sarv'lca 

Unit r 



70 



/OO 



SB 



4o 



83 



SO 



S& 



7/ 



6o 



4Z 



So 



50- 



SQ 



29 



24 



JZ 



.7 



TOTAI. 



8Z 



63 



87 



6? 



4-? 



ez 



51 



65- 



TABii // I Continuity of C^r« 
For Zron-Oeflclency Ancal*" 



TABU // I (Oont.) 





• 

* 

DESCRIPTION * . 


Servico 
Unit A 
^ % N 


Service 
Unit B 
% N 


Service 
Unit C 

% H 


Service 
Unit D 

t M 


Service 
Unit E 

%. u 


Service 
Unit F 


TOTAL 


Screening 
Yield 

k^OlUtlGO 


Percent o^ infants and prenatal patients 
screened for. anemia who hid a llc]^ 11 
a/jrVbr Hct 33. 








sz- 


2i 


n 


L3 


48 


TiZ 


At, 




22 




n 

337 , 


Of Anemia 

Docun^tation 

l^ta 


Percent of patients with a repeat iict 
anct/Gr Kgb 3-6 weeks after the^rap^i j 
started, whidi resulted in a Hct 33 
andl/or H* 11. . | / 




1 


So 


t 




1 






40 




o 


4 


SS 





4 

r.iHTrA'mn IXSCriPTIOM 


8*rvi6t 

Unit A 


S»)n 

Unil 


irlca 
b B 


Sor 


vies 
f C 
N 


' Ser 


vice 
t D • 


Servlc* 

imi* « • 


Ser 
imi 


vlca 


To 


tal 


* 


M.. 




M 


% 


N 






1 


f 


'I . 


^-JI 


Contact 
Rata 


Percent of patients with a positive urlno - 
culture ( lOO^OOO organiGos) who loado 
contact with the healtli cajje system within 
2 'iseks of Dositive culture* 




€o 


no 








no 
(7 






SO 










f^nonnal 

Screening 

Keoognition 


Percent of patients making contact within ^ 
2 weeks, who^had any statennent or action 
indicating tliat positive culturo was 


9B 


4Z 


53 






44- 




/f 

r 


■n 


43 




TO 






Diagnostic 
Evaluation 
Bata 


Percent of patients witli reoogniticn pf } 
positive culture, Uio had dooxnentation 
of the history, description of synpbcns, 
#-#:5or^>i-;4t-iirfl ' nalDatinn of tJifi^abdcnien^ 


44 


41 

— Jk 


53 


3o 




43 


C7 






4U 






1 


Z08 


Txeatncnt 
Rata 


Peroant of patients with recognition of 
positive culture, who were plaoed^on an 
&norr£>riat:a anhibiotic therapv within 2' 
weeks of positive' culture,^ , ^ ' . 




41 


93 






'43 


f 

/CO 






4U 


9f 


33 






Contact 
Rata 


Percent of patients tr^ated^^^ made 
contact with the health care system within 
1<*4 weeks after the treatJient started. 


74 


3? 


/7 












/ 


44 






/LA 




Pollcw-up 
Rsbogihition 


Percent of patients making contact for 
whom there was ary statement of action 
indicahina feoobnitlon of the x^^eci for 
follow-iip. . » 


S2 


2^ 


SO 


* 




3/ 






3i 








^? 




Rata 


Percent of patients vii^ recognition of the 
' need for follaf~i^ who received a urim cul- 
ture within 1-4 weeks after treatment started. 


^7 






w i 




iL 




f 


sa 


S ' 










Negative 

Becultum 

Rata 


Percent of patients treated and followedruj^ 
vJtxQ had a repeat urine culture resulting in 
100,000 organisn)3. 






44' 


9 


BO 


55" 


Be 


•5 




4 


O 


2 


67 


5"ff 



TABLE 12. a Continuity of Caro 
For Urinary Tract Infections 
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Table 14: Proi^cting Overall Process Success Through 
Lnp^rtTemerits In SelectQd Cldnica^l Events: 
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* ^ . ^ TABLE 15: Iron Deficiency Anemia - Projecting 

ERIC cro ' ' ^ Overall Process, Succfess Through Im^ 

nsM 'O^ ^ ; V ' provements In Selected Clinical Events. 
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TABLB^16: Iron-Deficiency Anemia - Probabilities 
Of Process^Success For Selected* 
-Functions and Functional Sequences. 



The^"(!ase Finding Rate" is calculated from the product of the following rates: 
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